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Examiner's responses to Applicant's remark 

1 . Applicants' amendment and arguments, filed 10/2/2006, have been considered. 

2. The amendment and arguments overcome the following set forth in paper 
20060526 mailed on 5/31/2006: 

objection to specification; 

— rejection to Claim 4 under 35 U.S. C. 112, second paragraph; 

— rejections to Claims 2, 4, 14-15 under 35 U.S.C. 102(a) as being anticipated by Debes 
et al. because Debes is not qualified as a prior art for the amended claims. 

3. Applicant's arguments with respect to claim 2, under 35 U.S.C. 102(e) as being 
anticipated by Vynne, have been considered but are moot in view of the new ground(s) of 
rejection due to the amendment. 

4. Applicant's arguments with regard to the followings are not persuasive: 

— rejections to Claims 4, 18-24, and 26-28 under 35 U.S.C. 102(e) as being anticipated 
by Vynne et al.; 

-- rejections to Claims 2, 14-15, 20, 22, 29-30 and 32-33 under 35 U.S.C. 102(e) as being 
anticipated by Hawkins et al. 

The Applicants referred to their arguments presented in the responses to previous 
rejections. The Examiner has considered again. The Examiner's responses to the previous 
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arguments remain valid and are not repeated here. Any response to any newly made point will be 
discussed in each claim. 



Claim Rejections - 35 USC § 102 



5. The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the United 
States before the invention thereof by the applicant for patent, or on an international application by another who has 
fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this title before the invention thereof by the 
applicant for patent. 



The changes made to 35 U.S.C. 102(e) by the American Inventors Protection Act of 1999 
(AIPA) and the Intellectual Property and High Technology Technical Amendments Act of 2002 
do not apply when the reference is a U.S. patent resulting directly or indirectly from an 
international application filed before November 29, 2000. Therefore, the prior art date of the 
reference is determined under 35 U.S.C. 102(e) prior to the amendment by the AIPA (pre-AIPA 
35 U.S.C. 102(e)). 

6. Claims 4, 18-24, and 26-28 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Vynne et al. (US patent 5,960,081.) 



a. Vynne teaches a method of segmenting a media object for parallel watermarking 
operations, the method comprising: 
for Claim 4 

- sub-dividing the media signal into segments; (Fig. 6. 1; column 27, lines 7-18; The 
images are divided into blocks.) 
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— distributing the segments to parallel processors; (Fig. 7.2; column 26, line 1 to column 
27, line 18; Fig. 7.2 shows the parallel processors. A group of B pe blocks is sent to each 
processor.) 

~ analyzing the media signal to prioritize segments of the media signal for digital 
watermark operations on the segments, wherein the media signal segments are prioritized for 
digital watermark embedding operations and wherein the media signal segments are prioritized 
such that segments that are more likely to carry a readable watermark signal are given higher 
priority for the embedding operations; (column 10, lines 32-48; column 24, line 65 to column 25, 
line 11; Fig. 6. 1; The images are divided into blocks. A subset U(n) of blocks suitable for coding 
is selected using the selection criteria discussed from column 17, line 54 to column 22, line 21. 
The selection process is a prioritization process, column 8, lines 25-35; The blocks are selected 
based on energy of a block to generate more-likely readable watermark signal.; column 33, lines 
19-23; The blocks can be selected also based on a secret key to generate more-likely readable 
watermark signal, when the watermark is under attack.) 

- performing parallel digital watermark operations on the prioritized segments in the 
parallel processors after the analyzing of the media object to prioritize the segments; (Fig. 7.2; 
column 26, line 1 to column 27, line 18; The analyzing can be performed before sending selected 
blocks to each watermarking processor or in each watermarking processor individually. In 
either case, parallel digital watermark operations are performed on the prioritized segments 
after said analyzing.) 

for Claims 18-19 
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— sub-dividing the media signal into segments; (Fig. 6.1; column 27, lines 7-18; The 
images are divided into blocks.) 

— distributing the segments to parallel processors; (Fig. 7.2; column 26, line 1 to column 
27, line 18; Fig. 7.2 shows the parallel processors. A group of Bp e blocks is sent to each 
processor.) 

— performing parallel digital watermark operations on the segments in the parallel 
processors (column 10, lines 32-48; Fig. 7.2; column 26, line 1 to column 27, line 18) wherein 
the media signal is segmented and prioritized for parallel watermark decoding operations based 
on probability of watermark detection; (column 22,line 22 to column 24, line 58; The recitation 
can be read as the media signal is prioritized for parallel watermark decoding operations based 
on probability of watermark detection. There is no connection between segmentation and 
probability. If the Applicants like to claim "segmented for parallel watermark decoding 
operations based on probability of watermark detection they could rewrite the limitation as 
"wherein the media signal is segmented and prioritized for parallel watermark decoding 
operations both based on probability of watermark detection".) 

— wherein the parallel processors comprise threads of execution on one or more hardware 
processing units; (column 26, lines 57-68; Each segment is processed separately and then 
combined.) 

for Claims 20-21 

— sub-dividing the media signal into segments; (Fig. 6.1; column 27, lines 7-18; The 
images are divided into blocks.) 
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— distributing the segments to parallel processors; (Fig. 7.2; column 26, line 1 to column 
27, line 18; Fig. 7.2 shows the parallel processors. A group of B pe blocks is sent to each 
processor.) 

— performing parallel digital watermark operations on the segments in the parallel 
processors (column 10, lines 32-48; Fig. 7.2; column 26, line 1 to column 27, line 18) wherein 
the watermark operations are performed by two or more watermark operation modules that 
perform a different watermarking task, and the watermark operation modules operate in parallel 
such that a watermarking task foe the media signal is distributed over the watermark operation 
modules performing different watermark functions on the media signal in parallel; (Fig. 7.2; 
column 10, lines 32-48; Fig. 7.2; column 26, line 1 to column 27, line 18; In column 26, lines 45- 
47 explicitly states that in the situation of one program, different execution is performed an 
different processors. ) n 

— wherein the watermark operation modules comprise a watermark generator, a 
perceptual analyzer and a watermark applicator. (Fig. 6.1; The part generating the signature is a 
watermark generator. "Criteria 612" is a perceptual analyzer. Embedder 618 is a watermark 
applicator. Each PE of Fig. 7.2 has the set shown in Fig. 6. 1.) 

b. For Claim 22, Vynne further teaches computer readable medium on which is 
stored instructions for performing the method of claim 20. (column 26, lines 1-54; column 27, 
lines 27-58; The instructions are stored in memory inside CRAY computer.) 

c. Vynne teaches a distributed digital watermark embedder comprising: 
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for Claims 23-24 and 26-28 

— a watermark signal generator for generating a watermark from a message; (column 1 , 
lines 43-51; Fig. 6.1; column 9, lines 45-59; The part generating the signature is a watermark 
generator. The signature is related with author of a document or other information, which is a 
message. The final watermark is generated from the signature.) 

— a perceptual analyzer for perceptually analyzing a media signal and generating 
perceptual control parameters used to control application of the watermark to the media signal; 
(Fig. 6. 1; "Criteria 612" is a perceptual analyzer. A subset U(n) of blocks suitable for coding is 
selected using the selection criteria based on perceptual analysis discussed from column 17, line 
54 to column 22, line 21.) 

. ~ a watermark applicator for receiving the media signal, the watermark and the 
perceptual control parameters, and for applying the watermark to the media signal according to 
the perceptual control parameters; wherein the watermark signal generator, the perceptual 
analyzer and the watermark applicator operate on distributed processors, wherein the distributed 
processors comprises independent threads of execution (Fig. 6.1; Fig. 7.2; column 10, lines 32- 
48; Fig. 7.2; column 26, line 1 to column 27, line 18; Embedder 618 is a watermark applicator. 
Each PE of Fig. 7.2 has the set shown in Fig. 6. 1 .) wherein variable watermarks are embedded in 
copies of a media signal by executing the perceptual analyzer on the media signal once to 
generate a perceptual mask that is dependent on the content of the media signal and is re-used by 
the watermark applicator to apply different watermarks from the watermark signal generator to 
the copies; (column 17, line 54 to column 22, line 22; column 27, line 59 to column 28, line 10; 
The criteria thresholds as those listed in column 22, lines 1-9 are the mask that is used for 
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selecting blocks for watermarking. The thresholds are adjusted based on perceptual analysis 
through direct view.) 

— including a media signal segmentation processor for sub-dividing a media signal into, 
segments for parallel processing in the embedder, wherein the embedder includes plural 
perceptual analyzers, which operate in parallel on segments of the media signal and wherein the 
embedder includes plural watermark signal applicators, which operate in parallel on segments of 
the media signal. (Figs. 6.1 and 7.2; column 27, lines 7-18; The images are divided into blocks. 
The part generating the signature is a watermark generator. "Criteria 612" is a perceptual 
analyzer. Embedder 618 is a watermark applicator. Each PE of Fig. 7.2 has the set shown in Fig. 
6.1.) 

7. Claims 2, 14-15, 20, 22, 29-30 and 32-33 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Hawkins et al. (US patent 6,389,421.) 

a. Hawkins teaches a method of segmenting a media object for parallel 
watermarking operations, the method comprising: 
for Claim 2 

- sub-dividing the media object into parts, including specifying the parts to be embedded 
with corresponding digital watermark messages and providing data used to control embedding of 
the corresponding digital watermarking messages in the parts; (column 9, lines 10-25; column 
10, lines 22-61; column 12, lines 17-39; The media signal is divided based on jobs.; column 10, 
lines 4-62; The segments are prioritized based on the user of the media signal to set a schedule.) 
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-- distributing the specified parts to parallel processors after specifying of the parts to be 
embedded with corresponding digital watermark messages; (column 6, lines 26-34; column 12, 
lines 17-39; A single number of watermarking process is assigned per available processor.) 

— performing parallel digital watermark operations on the specified parts in the parallel 
processors according to the data used to control the embedding, (column 6, lines 26-358; column 
12, lines 17-39; A single number of watermarking process is assigned per available processor.) 

for Claims 14-15 

— sub-dividing the media object into segments; (column 9, lines 10-25; column 10, lines 
22-61; column 12, lines 17-39; The media signal is divided based on jobs.) 

— distributing the segments to parallel processors; (column 6, lines 26-34; column 12, 
lines 17-39; A single number of watermarking process is assigned per available processor.) 

— performing parallel digital watermark operations on the segments in the parallel 
processors (column 6, lines 26-358; column 12, lines 17-39; A single number of watermarking 
process is assigned per available processor.) wherein the media signal is segmented into blocks 
and the parallel digital watermarking operations are performed in priority order on based on a 
memory parameter of processing hardware, and the memory parameter comprises a unit of 
memory used to swap data into system memory in a virtual memory system; (column 10, lines 
40-44; column 12, lines 25-39, The segment requested for a subsequent watermarking process 
depends on data-size-dependent points that is related to the characteristic of storage facility, 
namely the data size cannot be larger than the storage. The storage is the maximum capacity 
which data can be swapped for processing. A task associated with points is a block of signal. The 
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digital watermarking operations are performed in cording to the points and thus in a priority 
order of the blocks.) 
for Claim 20 

- sub-dividing the media signal into segments; (column 9, lines 10-25; column 10, lines 
22-61; column 12, lines 17-39; The media signal is divided based on jobs.) 

- distributing the segments to parallel processors; (column 6, lines 26-34; column 12, 
lines 17-39; A single number of watermarking process is assigned per available processor.) 

- performing parallel digital watermark operations on the segments in the parallel 
processors (column 6, lines 26-358; column 12, lines 17-39; A single number of watermarking 
process is assigned per available processor.) wherein the watermark operations are performed by 
two or more watermark operation modules that perform a different watermarking task, and the 
watermark operation modules operate in parallel such that a watermarking task foe the media 
signal is distributed over the watermark operation modules performing different watermark 
functions on the media signal in parallel, (column 6, lines 26-58; column 12, lines 17-39; A 
single number of watermarking process is assigned per available processor. Also see the above 
Examiner's responses.) 

b. For Claim 22, Hawkins further teaches computer readable medium on which is 
stored instructions for performing the method of claim 20. (See claim 20 of Hawkins) 

c. For Claims 29-30 and 32-33, Hawkins teaches a system for parallel watermark 
embedding comprising: 
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— a media signal pre-processor operable to receive a media object and divide the media 
object into segments for parallel watermark embedding operations; (column 9, lines 10-25; 
column 10, lines 22-61; column 12, lines 17-39; The media signal is divided based on jobs.) 

— a server for distributing the segments to parallel processors for parallel watermark 
embedding operations; (column 6, lines 26-58; column 12, lines 17-39; A single number of 
watermarking process is assigned per available processor.) 

— wherein the segments are prioritized for embedding operations, wherein the segments 
are prioritized for embedding operations based on hardware resource constraints; (column 10, 
lines 4-62; column 1 1, lines 12-26; The segments are prioritized based on a schedule. The 
worker thread is performed based on a resource allocation schedule which indicates hardware 
resource constraints.) 

~ a load balancer for distributing segments to the parallel processors based on priority, 
(column 10, lines 4-62; column 11, lines 12-26; The segments are prioritized based on a 
schedule. The load balance is based on points allocated to users or size of data.) 

Claim Rejections - 35 USC § 103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that 
the subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 
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9. Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over Vynne et 
al. (US patent 5,960,081.) 

Vynne teaches in one embodiment a method of segmenting a media object for 
watermarking operations, the method comprising: 

~ sub-dividing the media object into parts, including specifying the parts to be embedded 
with corresponding digital watermark messages and providing data used to control embedding of 
the corresponding digital watermarking messages in the parts; (column 24, line 65 to column 25, 
line 11; Fig. 6. 1; column 27, lines 7-18; The images are divided into blocks. A subset U(n) of 
blocks suitable for coding is selected using the selection criteria discussed from column 17, line 
54 to column 22, line 21 . The selection process is a prioritization process. ) 

— performing digital watermark operations on specified parts according to the data used 
to control the embedding, (column 10, lines 32-48; Fig. 7.2; column 26, line 1 to column 27, line 
18; There are only two priority order: suitable and non-suitable.) 

Vynne teaches in another embodiment a method of segmenting a media object for 
parallel watermarking operations, the method comprising: 

— distributing image signal to parallel processors for digital watermark; (Fig. 7.2; column 
26, line 1 to column 27, line 18; Fig. 7.2 shows the parallel processors. A group of B pe blocks is 
sent to each processor.) 

— performing parallel digital watermark operations on the prioritized segments in the 
parallel processors according to the priority order of the prioritized segments; (column 10, lines 
32-48; Fig. 7.2; column 26, line 1 to column 27, line 18; There are only two priority order: 
suitable and non-suitable.) 
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Vynne, in column 27, lines 9-10, teaches "the blocks are divided between different 
processors. The Examiner interpreted "the blocks" as the selected blocks. The Applicants 
interpreted "the blocks" as the blocks of the image prior the specifying process. For reducing the 
argument between the Applicants and the Examiner, the Examiner here takes the Applicants' 
position. Therefore, Vynne does not teach the limitation related to "distributing the specified 
parts to parallel processors after specifying of the parts". 

Vynne teaches, in column 26, line 1 to column 27, line 5, that using parallel processing 
reduces the processing time. The parallel processing can be applied to various tasks. 
Furthermore, in column 17, line 7 to column 22, line 21, Vynne selects blocks for watermarking 
based on visibility concern and the criteria related to a whole frame. It has a concern of having 
inadequate number of selected blocks in column 17, lines 45-53. In divided segments, it is more 
likely to have a segment with inadequate number of selected blocks than its corresponding whole 
image because its size is smaller than a whole image and the numbers are not even distributed 
among the segments. It is desirable to have adequate number of selected blocks for watermarking 
an image. It would have been obvious to one of ordinary skill in the art, at the time of the 
invention, to select blocks in a whole image as taught by Vynne and distribute the selected 
blocks to Vynne's parallel processors for watermarking because the combination reduces a 
complicated synchronization mechanism as pointed out by Vynne. This modification thus 
teaches all the limitations recited in Claim 2. 
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10. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hawkins 
et al. (US patent 6,389,421) as applied to Claim 14, and further in view of Peters et al. (US 
patent 6,374,336.) 

Hawkins teaches the parent Claim 14. However, it does not teach the feature related to 
memory alignment boundary recited in Claim 16. 
Peters teaches a method of watermarking: 

— wherein segmenting signals based on a memory parameter that comprises a memory 
alignment boundary, (column 10, lines 7-30) 

It is desirable to process image at the correct division of data to reduce loss or 
degradation of data. It would have been obvious to one of ordinary skill in the art, at the time of 
the invention, to apply Peters' teaching to segment Hawkins' data based on memory alignment 
boundary, because the combination preserves better data quality. 

1 1 . Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over Vynne et 
al. (US patent 5,960,081) in view of Kawaguchi et al. (US patent 6,473,516.) 

Vynne teaches the steps of sub-dividing, distributing, and performing recited in Claim 17, 
as evident in the discussion above related to Claim 4. 

However, it does not teach the feature related to bit planes recited in Claim 17. 
Kawaguchi teaches a method of steganography which is watermarking: 

— wherein a media signal is segmented and prioritized based on bit plane to reduce the 
number of bit planes of the media signal subjected to watermarking operations, (column 2, lines 
32-40; column 5, lines 26-37; Watermarking is done only on some bit planes.) 
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It is desirable to increase information hiding capacity in watermarking. It would have 
been obvious to one of ordinary skill in the art, at the time of the invention, to include 
Kawaguchi's segmentation and prioritization method in Vynne's watermarking method, because 
the combination improves information hiding capacity. The combination thus teaches: 

— wherein a media signal is segmented by bit planes and the bit planes are prioritized for 
watermarking operations in priority order to reduce the number of bit planes of the media signal 
subjected to watermarking operations. 

12. Claim 34 is rejected under 35 U.S.C. 103(a) as being unpatentable over Shinoda 
(US 6,61 1,830) in view of Vynne et al. (US patent 5,960,081.) 

Shinoda teaches a batch digital watermark registration and embedding system 
comprising: 

a network interface for receiving ID registration requests, the requests including a list 
of media signal files and information to be linked with the media signal files via data embedded 
in the media signal files; (Fig. 1; column 1, lines 40-46; column 3, lines 7-50; column 5, lines 1- 
35; Many files, each having an ID, are inputted at least one by one for registration.) 

— a batch registration loader for creating records in a registration database corresponding 
to identifiers for each of the media signal files; (column 4, line 64 to column 5, line 35; Fig. 5 
shows records in the database.) 

— a batch registration extractor for reading the registration database and creating an 
embedder control file, including identifiers, a corresponding list of media signal files, and 
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embedding instructions for controlling embedding of the identifiers in the media signal files; 
(column 4, line 64 to column 5, line 35) 

- a digital watermark embedder for performing digital watermark embedding operations 
on each file to hide the identifiers in the media signal files, (column 4, line 64 to column 5, line 
46) 

However, Shinoda does not teach the feature related to parallel digital water embedding. 
Vynne teaches a system of segmenting a media signal for parallel watermarking 
operations, comprising: 

- sub-dividing the media signal into segments; (Fig. 6.1; column 27, lines 7-18; The 
images are divided into blocks.) 

- distributing the segments to parallel processors; (Fig. 7.2; column 26, line 1 to column 
27, line 18; Fig. 7.2 shows the parallel processors. A group of B pe blocks is sent to each 
processor.) 

- performing parallel digital watermark operations on the segments in the parallel 
processors, (column 10, lines 32-48; Fig. 7.2; column 26, line 1 to column 27, line 18) 

It is desirable to speed up watermarking of data files. It would have been obvious to one 
of ordinary skill in the art, at the time of the invention, to use Vynne's parallel watermarking 
approach in Shinoda's system to perform parallel watermarking for a set of files, because the 
combination speeds up watermarking and therefore registration process. The combination thus 
teaches: 
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— a parallel digital watermark embedder for segmenting media signal files into segments 
and for distributing the segments to parallel processors for performing parallel digital watermark 
embedding operations on the segments to hide the identifiers in the media signal files. 

Conclusion 

13. THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). The Applicant is 
reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for response to this final action is set to expire THREE 
MONTHS from the date of this action. In the event a first response is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 
1 .136(a) will be calculated from the mailing date of the advisory action. In no event will the 
statutory period for response expire later than SIX MONTHS from the date of this final action. 

14. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 



Application/Control Number: 10/053,488 



Page 18 



Art Unit: 2624 

the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

15. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Wenpeng Chen whose telephone number is 571-272-743 1 . The 
examiner can normally be reached on 8:30 am - 5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Matthew Bella can be reached on 571-272-7778. The fax phone numbers for the 
organization where this application or proceeding is assigned are 571-273-8300 for regular 
communications and 571-273-8300 for After Final communications. TC 2600 ? s customer service 
number is 571-272-2600. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 571-272-2600. 



Wenpeng Chen 
Primary Examiner 
Art Unit 2624 



December 12, 2006 




